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Abstract: Operative practice using surgical simulators has become a part of training in many 
surgical specialties, including ophthalmology. We introduce a virtual reality retina surgery 
simulator capable of integrating optical coherence tomography (OCT) scans from real patients 
for practicing vitreoretinal surgery using different pathologic scenarios. 
Keywords: optical coherence tomography 

Introduction 

Surgical simulation has been used in several surgical specialties to provide assessment 
and acquisition of skills for particular surgical procedures. 1 Traditional wet labora- 
tory or animal environments have become either obsolete or ethically unacceptable. 
Ophthalmic surgery simulators are a popular training tool for basic surgical skills 
acquisition before entering clinical practice. 

Currently available simulators for ocular surgery include EYESi (VRmagic, 
Mannheim, Germany), Phaco Vision (Melerit Medical, Linkoping, Sweden), and 
Micro VisTouch (Immersive Touch Inc., Chicago, IL, USA). All three simulators use 
the stereoscopic microscope while practicing the steps of cataract surgery. The first 
simulator has been in use the longest, and therefore, construct validity for this device 
has been demonstrated for many steps of cataract surgery. M The Micro VisTouch sur- 
gical simulator has been used and validated predominantly in applications other than 
ophthalmology. 5 - 6 Therefore, the number of published articles in ophthalmic literature 
for both devices is limited. At this time, EYESi simulator is the only device that has 
been validated in peer-reviewed publications and is available on the market for the 
training of both cataract and vitreoretinal surgery. 2 ^ 7 

Among the available simulators, the Micro VisTouch simulator is the only device 
that has incorporated a haptic (tactile) feedback interface. As per published surveys, 
the integration of the tactile feedback has been shown to provide more realistic 
operative experience among ophthalmic surgeons. 8 Furthermore, the Micro VisTouch 
simulator is the only device that provides a full virtual experience, which includes 
the instruments and the head and eye of the virtual patient. The trainee works with 
virtual tissues in the space. In contrast, both PhacoVision and EYESi devices use an 
immobile physical head and eye. 

In an attempt to follow the fast-evolving advances in retinal surgery, we feel there 
is an unmet need for advanced surgical simulator training in vitreoretinal interface 
diseases. The integration of retinal images from the 3D optical coherence tomography 
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(OCT) volume scans, which could serve as a disease template, 
is a further step to bring surgical simulation closer to reality. 
This report for the first time describes the integration of OCT 
images into a virtual reality surgical simulator. 

Methods 

For the purpose of the study we used random, previously 
acquired patients' images from the database of the King 
Khaled Eye Specialist Hospital in Riyadh, Saudi Arabia. 
Eyes with epiretinal membrane (n=3) and macular hole 
(n=2) were imaged using the RTVue instrument (Optovue, 
Freemont, CA, USA). The image raw data were downloaded 
exported with no patient identifier, and used for 3D rendering 
in Micro VisTouch. The study adhered to the tenets of the 
Declaration of Helsinki in clinical research. 

We then designed a computer-based simulator for epireti- 
nal membrane (ERM) and internal limiting membrane (ILM) 
peeling procedures with the idea to develop a high perfor- 
mance haptics-, physics-, and graphics-enabled simulator. 
The study was conducted on the Micro VisTouch surgical sim- 
ulator (Figure 1), which has the following specifications: Dell 




Figure I An image of an operator using virtual reality system MicroVisTouch 
(ImmersiveTouch, Chicago, IL, USA) using haptic (tactile) feedback and stereo 
viewer for vitreoretinal surgery simulation. 



precision T7500 with Intel Xeon X5690 6 cores CPU, 12GB 
RAM, NVIDIA Quadro FX 6000 graphics card SensAble 
Phantom Omni haptic device, and Microsoft Windows 7 
64-bit OS. High fidelity haptic feedback is rendered to pro- 
vide the sense of real surgery sensations. Opening and closing 
of the forceps is governed by a pressure sensor attached to 
the Geomagic Touch haptic device. The deformable retina 
is modeled from volumetric data generated from the OCT 
scan (Optovue) using position-based dynamics with improved 
performance over traditional mass-spring models. 

Results 

A customized peeling algorithm with full controllability 
was developed to simulate the peeling of the ERM and ILM. 
Figure 2 shows an example of a successful integration of an 
OCT image from a real patient with vitreoretinal interface 
abnormality which will serve as a template for ERM removal 
practice. The surface membranes can be distinguished from 
retinal tissue on the integrated OCT scan. A combination of 
vertex and fragment shaders is adopted to provide improved 
realism on graphical/visual effect. The forceps are used for 
surgical simulation and the user is instructed to apply enough 
pressure to the sensor in order for the membrane not to slip 
out of the forceps. 

Several metrics can be used to assess surgical performance. 
The circularity score measures how perfect the circle of 
removed ERM or ILM is with respect to an ideal peel. The 
accuracy score indicates the number of times the retina is 
touched by the forceps. 

The fluency score indicates the number of times the for- 
ceps are closed to grab the membrane. These all can be used 
as part of surgical skills evaluation both at initial performance 
and subsequent sessions. 

Discussion 

Virtual reality is a computer-simulated environment that 
simulates physical presence in places and where the user 
interacts with graphic software which can provide visual, 
tactile, and auditory feedback. Ophthalmic surgical simula- 
tion is becoming increasingly popular, and so far, is most 
commonly used for cataract surgery practice. Recently, the 
International Forum of Ophthalmic Simulation has been 
created to enhance training programs and educational cur- 
riculum in surgical simulations. 9 ' 10 

While cataract surgery is routinely trained on simula- 
tors, retinal surgical simulation is in general less common. 
Vitreoretinal surgery is a complex surgery requiring a 
high level of dexterity and coordination, and the learning 
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Figure 2 Left panel: posterior pole image of an eye with epiretinal membrane and surface wrinkling. Central panel: OCT B-scan of the same eye showing retinal wrinkling 
and an epiretinal membrane (arrowhead). Right panel: the same OCT image integrated into a surgical simulator with an operator practicing epiretinal membrane removal 
using virtual forceps. 

Abbreviation: OCT, optical coherence tomography. 



curve can be much longer compared to other ophthalmic 
procedures. Few vitreoretinal surgical simulators have been 
introduced in the past and their use has remained limited. 
Hikichi et al proposed a virtual technology system consisting 
of four major parts: high-resolution color stereo binoculars, 
haptic devices, foot switches, and a high-speed graphics 
computer. The system was designed for the practice of 
removing pre- and sub-retinal membranes. 11 Wagner et al 
showed a computer-based medical training workstation 
for the simulation of intraocular eye surgery in which the 
surgeon manipulates two instruments inside a mechanical 
model of the eye. The instrument positions are tracked by 
charge-coupled device (CCD) cameras and monitored by 
a PC which renders the scenery using a computer-graphic 
model of the eye and the instruments. 12 Later, Verma et al 
presented another virtual reality vitreoretinal simulator 
simulating the initial steps of vitreoretinal surgery such as 
vitreous removal. Soft tissue computer modeling was carried 
out to mimic the removal of vitreous opacities. 13 At pres- 
ent, the most common device for practicing steps in retina 
surgery is the EyeSi system, which uses a manikin head. 
The surgical instruments are visualized within the model 
eye via sensors that are used to gauge instrument position 
and movement. No tactile feedback with ocular tissues is 
provided by the simulator. The user can select contact lens or 
binocular indirect opthalmomicroscope (BIOM) visualiza- 
tion as well as a variety of virtual surgical instruments such 
as a light pipe, forceps, scissors, and vitrectomy hand pieces. 
The EyeSi® records performance metrics that include iatro- 
genic injuries. It has been used in a curriculum to enhance 
ophthalmic surgical training. 14 

A new concept in surgical simulation is haptic technol- 
ogy with manipulation in virtual space rather than touching 
a physical organ model. The PHANTOM® Omni™ model by 
SensAble Phantom Omni (Woburn, MA, USA) is a widely 
used haptic device enabling 3D touch-enabled systems for 



medical modeling. It has been used in several specialties. 15-17 
Similarly, Micro VisTouch uses a virtual reality haptic feed- 
back approach for simulation and has been validated in surgi- 
cal specialties. 6 It has also been applied to ophthalmology in 
cataract surgery simulation. Banerjee et al investigated the 
concurrent validity of capsulorhexis performance metrics 
(duration, number of capsular grabs per completed capsu- 
lorhexis, and circularity of the capsulorhexis) and compared 
it to live surgeries. 18 

In this report, we are interested in using the concept of 
virtual reality with haptic technology for vitreoretinal surgery 
and in customizing the training to existing disease from real 
patients rather than repeatedly presenting the same model 
and task to a trainee. For this reason, we integrated OCT 
scans of vitreoretinal conditions to a surgical simulator. The 
integrated images serve as an image template for practic- 
ing surgical steps. Similar to cataract surgery simulation 
with this technology, several metrics can be used to assess 
surgical performance. The circularity score measures how 
perfect the circle of removed ERM or ILM is with respect 
to an ideal peel. The accuracy score indicates the number of 
times the retina is touched by the forceps. The fluency score 
indicates the number of times the forceps are closed to grab 
the membrane. These can all be used as part of surgical 
skills evaluation both at initial performance and subsequent 
sessions. Further studies are needed to validate this approach 
in comparison to live surgeries. 

In summary, the concept introduced here can be uti- 
lized to practice image-based vitreoretinal surgery using 
OCT scans from real patients. Contrary to other surgical 
simulators which use a standardized pre-operative starting 
condition, the integration of retinal imaging into a surgical 
simulator will allow students to be challenged with numer- 
ous different conditions. We believe this innovation will 
contribute to enhancing preclinical surgical experience in 
vitreoretinal surgery. 
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